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IMAGE PIXEL DATA FOR A PLURALITY 
OF FOVs 



FUSE IMAGE PIXEL DATA OF PLURALITY 

OF FOVs 




SEGMENTATION OF MOVING OBJECTS 
IN SEARCH AREA 
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PROVIDE A PLURALITY OF IMAGING 
DEVICES, EACH HAVING A FOV 
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POSITfON AN IMAGING DEVICE SUCH 
THAT AT LEAST 25% OF THE FOV OF 
EACH IMAGING DEVICE OVERLAPS 
WITH A FOV OF AT LEAST ONE OTHER 
IMAGING DEVICE 
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DEFINE A SEARCH AREA (e.g., an area 
having outer edges about its perimeter) 
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PROVIDE A PLURALITY OF CAMERAS 
EACH HAVING A FOV 
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POSITION CAMERAS 




AT OTHER 




INSTALLATION SITES 
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POSITION A FIRST CAMERA AT AN 
INSTALLATION SITE SUCH THAT IT'S 
FOV BORDERS AN OUTER EDGE OF 
THE SEARCH AREA 



POSITION ONE OR MORE ADDITIONAL 
CAMERAS AT THE INSTALLATION SITE, 

IF NECESSARY, TO COVER ONE OR 
MORE RESPECTIVE AREAS ADJACENT 
TO THE AREA COVERED BY THE FIRST 

CAMERA 



DETERMINE THE LIMITING RANGE FOR 
THE POSITIONED CAMERAS FOR USE 
IN OBTAINING USEFUL COVERAGE 
AREA 
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PROVIDE ANY ADDITIONAL 
ADJUSTMENTS (e.g., in view of little planar 

space) 



Title: MOVING OBJECT ASSESSMENT SYSTEM AND METHOD 
Applicant(s): PAVLIDIS et al. 

Serial No.: Unassigned Filed: Herewith Docket: H0002442-03 

Express Mail No.: EL 888274065 US Sheet 6 of 18 




IT- 



Title: MOVING OBJECT ASSESSMENT SYSTEM AND METHOD 
Applicant(s): PAVLIDIS etal. 



Serial No.: Unassigned Filed: Herewith 

Express Mail No.: EL 888274065 US 



Docket: H0002442-03 



Sheet 7 of 18 



FI6.-7 




23a 



PROVIDE IMAGE PIXEL DATA FOR A 
PLURALITY OF OVERLAPPING FOVs 
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IDENTIFY MULTIPLE LANDMARK 
PIXEL COORDINATES IN OVERLAPPING 
AREA OF A PAIR OF FOVs 
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FUSE FOVs BY COMPUTING THE 
HOMOGRAPHY TRANSFORMATION 

MATRIX USING THE MULTIPLE 
LANDMARK PIXEL COORDINATES IN 
THE OVERLAPPING AREA 
THEREBETWEEN 
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USE TRANSFORMATION MATRIX TO 
FUSE IMAGE PIXEL DATA INTO SINGLE 
IMAGE HAVING GLOBAL COORDINATE 
SYSTEM 
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PROVIDING PIXEL VALUE DATA ACQUIRED OVER 
TIME FOR A PLURALITY OF PIXELS OF A 
SEARCH AREA 



PROVIDING A PLURALITY OF TIME VARYING 
NORMAL DISTRIBUTIONS FOR EACH PIXEL OF 
THE SEARCH AREA BASED ON AT LEAST THE 
PIXEL VALUE DATA 



INITIALLY ORDERING/LABELING THE PLURALITY 
OF TIME VARYING NORMAL DISTRIBUTIONS FOR 
EACH PIXEL BASED ON A PROBABILITY THAT 
THE TIME VARYING NORMAL DISTRIBUTION IS 
REPRESENTATIVE OF BACKGROUND OR 
FOREGROUND IN THE SEARCH AREA 



UPDATING THE PLURALITY OF TIME VARYING 
NORMAL DISTRIBUTIONS FOR EACH PIXEL IN 
THE SEARCH AREA BASED ON THE UPDATE 
PIXEL VALUE DATA FOR THE PIXEL 
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PROVIDING UPDATE PIXEL VALUE DATA FOR 
EACH OF THE PLURALITY OF PIXELS OF THE 
SEARCH AREA IN AN UPDATE CYCLE 
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REORDERING/LABELING THE PLURALITY OF 
TIME VARYING NORMAL DISTRIBUTIONS FOR 
EACH PIXEL BASED ON A PROBABILITY THAT 
THE TIME VARYING NORMAL DISTRIBUTION IS 
REPRESENTATIVE OF BACKGROUND OR 
FOREGROUND IN THE SEARCH AREA 



DETERMINING WHETHER EACH PIXEL IS 
BACKGROUND OR FOREGROUND BASED ON 
THE ORDERED/LABELED PLURALITY OF TIME 
VARYING NORMAL DISTRIBUTIONS 
FOR THE PIXEL 
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RECEIVE UPDATE PIXEL VALUE DATA FOR EACH 
OF THE PLURALITY OF PIXELS OF THE SEARCH 
AREA IN AN UPDATE CYCLE 
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FOR EACH PIXEL, CREATE A NARROW 
DISTRIBUTION THAT REPRESENTS THE UPDATE 

PIXEL VALUE 



I 



COMPUTE THE DIVERGENCE BETWEEN THE 
NARROW DISTRIBUTION THAT REPRESENTS 
THE UPDATE PIXEL VALUE FOR A PIXEL AND 

EACH OF ALL OF THE PLURALITY OF TIME 
VARYING NORMAL DISTRIBUTIONS FOR THE 
RESPECTIVE PIXEL 



t 

UPDATE THE PLURALITY OF TIME VARYING 
NORMAL DISTRIBUTIONS FOR THE PIXEL IN THE 
SEARCH AREA IN A MANNER DEPENDENT ON A 

MATCHING OPERATION THAT IS BASED ON 
DIVERGENCE MEASUREMENTS BETWEEN THE 
NARROW DISTRIBUTION AND EACH OF ALL OF 
THE PLURALITY OF TIME VARYING NORMAL 
DISTRIBUTIONS FOR THE RESPECTIVE PIXEL 



NO 



REORDERING/LABELING THE PLURALITY OF 
TIME VARYING NORMAL DISTRIBUTIONS FOR 
THE PIXEL BASED ON A PROBABILITY THAT THE 
TIME VARYING NORMAL DISTRIBUTION IS 
REPRESENTATIVE OF BACKGROUND OR 
FOREGROUND IN THE SEARCH AREA 



COMMIT THE STATE OF THE RESPECTIVE PIXEL 
TO A FOREGROUND OR BACKGROUND STATE 
BASED ON THE REORDERED/LABELED 
PLURALITY OF TIME VARYING NORMAL 
DISTRIBUTIONS FOR THE PIXEL 




OPTIONALLY DISPLAY IMAGE OF 
FOREGROUND/BACKGROUND 
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ATTEMPT TO MATCH THE NARROW 
DISTRIBUTION THAT REPRESENTS THE 
UPDATE PIXEL VALUE FOR A PIXEL TO 
EACH OF ALL OF THE PLURALITY OF 
TIME VARYING NORMAL 
DISTRIBUTIONS FOR THE RESPECTIVE 

PIXEL 
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UPDATE THE PLURALITY OF TIME VARYING 
NORMAL DISTRIBUTIONS FOR THE PIXEL BY 
GENERATING A POOLED DISTRIBUTION 
BASED ON THE NARROW DISTRIBUTION 
POOLED WITH THE MATCHED DISTRIBUTION 
USING THE METHOD OF MOMENTS 
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UPDATE THE PLURALITY OF TIME VARYING 
NORMAL DISTRIBUTIONS FOR THE PIXEL BY 
REPLACING THE DISTRIBUTION MOST 
REPRESENTATIVE OF A FOREGROUND 
STATE WITH A NEW DISTRIBUTION BASED 
ON THE UPDATE PIXEL VALUE 



REORDERING/LABELING THE PLURALITY OF 
TIME VARYING NORMAL DISTRIBUTIONS FOR 
THE PIXEL BASED ON A PROBABILITY THAT 
THE TIME VARYING NORMAL DISTRIBUTION IS 
REPRESENTATIVE OF BACKGROUND OR 
FOREGROUND IN THE SEARCH AREA 
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REORDERING/LABELING THE PLURALITY OF 
TIME VARYING NORMAL DISTRIBUTIONS FOR 

THE PIXEL WITH THE NEW DISTRIBUTION 
BEING REPRESENTATIVE OF FOREGROUND 
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COMMIT STATE OF PIXEL TO FOREGROUND 
OR BACKGROUND DEPENDING ON WHETHER 
THE POOLED NORMAL DISTRIBUTION IN THE 
ORDER OF DISTRIBUTIONS IS 
REPRESENTATIVE OF FOREGROUND OR 
BACKGROUND 



COMMIT STATE OF PIXEL TO 
FOREGROUND 
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CONVERT TRACKS OF MOVING 
OBJECTS INTO COORDINATE SYSTEM 
OF SEARCH AREA (e.g., drawing of search 
area including landmarks) 



PROVIDE PREDEFINED FEATURE 
MODEL(S) CHARACTERISTIC OF 
NORMAL AND ABNORMAL MOVING 
OBJECTS 



PROVIDE FEATURES SUCH AS 
TRAJECTORIES AND CALCULATED 

FEATURES ASSOCIATED WITH 
TRACK(S) REPRESENTATIVE OF A 
MOVING OBJECT 



COMPARE FEATURES ASSOCIATED 
WITH TRACK(S) TO PREDEFINED 
FEATURE MODEL CHARACTERISTIC OF 
NORMAL AND/OR ABNORMAL MOVING 
OBJECTS (e.g., threatening versus non- 
threatening moving persons/cars) 




DETERMINE WHETHER A MOVING 
OBJECT IS NORMAL OR ABNORMAL 
BASED ON THE COMPARISON 
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ACQUIRE TRACKS AND CALCULATED 
FEATURES ASSOCIATED WITH THE 

TRACK(S) REPRESENTATIVE OF ONE 
OR MORE MOVING OBJECTS OVER 
TIME (e.g., couple of weeks) 




GROUPING TRACKS (AND ASSOCIATED 
CALCULATED FEATURES) BASED ON 
CERTAIN CHARACTERISTICS OF SUCH 
INFORMATION (e.g., circuitousness) INTO 
CLUSTERS 





IDENTIFY THE TRACKS OF THE LARGE 
CLUSTER AS NORMAL 



ANALYZE EACH TRACK OR THE 
TRACKS OF THE SMALLER CLUSTERS 



o 



USE AS A FEATURE OR PART OF A 
PREDEFINED FEATURE INFORMATION 
MODEL TO IDENTIFY TRACKS AS 
NORMAL 




USE AS A FEATURE OR 
PART OF A PREDEFINED 
FEATURE INFORMATION 

MODEL TO IDENTIFY 
TRACK(S) AS ABNORMAL 



DISREGARD TRACK(S) 
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